A Design of Metadata Server Cluster in Large Distributed Object-based Storage
نویسندگان
چکیده
In large distributed Object-based Storage Systems, the performance, availability and scalability of the Metadata Server (MDS) cluster are critical. Traditional MDS cluster suffers from frequent metadata access and metadata movement within the cluster. In this paper, we present a new method called Hashing Partition (HAP) for MDS cluster design to avoid these overheads. We also demonstrate a design using HAP to achieve good performance of MDS cluster load balancing, failover and scalability.
منابع مشابه
A Novel Architecture Design of Large-Scale Distributed Object Storage System
A novel architecture design of large-scale distributed object storage system (called DOSS) is proposed. Our design takes several aspects effecting on the overall performance of DOSS into consideration, including an improved model of interaction based on the traditional interactive mode of object-based storage systems, MDS(Metadata Server) management scheme and a load balancing scheme combines t...
متن کاملCeph: A Scalable Object-Based Storage System
The data storage needs of large high-performance and general-purpose computing environments are generally best served by distributed storage systems. Traditional solutions, exemplified by NFS, provide a simple distributed storage system model, but cannot meet the demands of high-performance computing environments where a single server may become a bottleneck, nor do they scale well due to the n...
متن کاملA Robust Fault-Tolerant and Scalable Cluster-wide Deduplication for Shared-Nothing Storage Systems
Deduplication has been largely employed in distributed storage systems to improve space efficiency. Traditional deduplication research ignores the design specifications of shared-nothing distributed storage systems such as no central metadata bottleneck, scalability, and storage rebalancing. Further, deduplication introduces transactional changes, which are prone to errors in the event of a sys...
متن کاملDesign and Implementation of a Distributed Nfs Server on Cluster of Workstations
The paper presents the design and implementation of a distributed NFS server which consists of multiple computers. The distributed NFS server provides the identical NFS file service as the traditional NFS server. No modification of client software is needed to use the distributed NFS service. The purpose of the distributed NFS server is to replace large collections of NFS servers. In addition, ...
متن کاملSnapshots in large-scale distributed file systems
Snapshots are present in many modern file systems, where they allow to create consistent on-line backups, to roll back corruptions or inadvertent changes of files, and to keep a record of changes to files and directories. While most previous work on file system snapshots refers to local file systems, modern trends like cloud and cluster computing have shifted the focus towards distributed stora...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004